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Abstract 


The performance of microwave systems and components for digital data 
transmission can be characterized by a plot of the bit-error rate as a function 
of the slgnal-to-nolse ratio (or Et,/N 0 ). Methods for the efficient automated 
measurement of bit-error rates and slgnal-to-nolse ratios, developed at NASA 
Lewis Research Center, are described. Noise measurement considerations and 
time requirements for measurement accuracy, as well as computer control and 
data processing methods, are discussed. 

Introduction 


The performance of microwave digital data transmission systems and com- 
ponents can be quantized In terms of the rate at which bit-errors occur. 
Amplitude and phase distortions In the system, as well as various types of 
Interference, can Induce errors. However, errors are primarily a function of 
the slgnal-to-nolse ratio present at the data demodulator Input. A curve of 
the bit-error rate (BER) as a function of the received energy-per-blt to noise 
ratio (Eb/N 0 ), given the other distortions present, sufficiently character- 
izes the performance of the system, allowing operating parameters to be chosen 
to yield a desired BER. 

Work In advanced digital communications systems at NASA Lewis has created 
a requirement for the laboratory evaluation of communications systems and sys- 
tem components. To meet this requirement, an automated system for the measure- 
ment of BER versus E|)/N 0 has been developed. The system Is designed to 
allow a complete BER curve to be accurately measured In a minimum amount of 

* time. 

The major considerations which must be addressed to Implement such a sys- 

* tern Include noise Insertion and Et,/N 0 measurement, time requirements for 
BER measurement accuracy, and the required computer control and data process- 
ing algorithms. Approaches which have been successfully applied to these areas 
are presented and discussed below. 



BER Versus E^ /N 0 Measurement Technique 

The BER Is usually measured over a range of values from about 10~ 2 to 10' 7 
or 10~ 8 . The lower figure Is determined by the system performance goal and Is 
chosen so that at least one data point beyond that goal has been taken. For 
example. If the system Is required to perform at a BER of 5xl0 -7 , the final 
data point taken must be less than 5xl0 -7 . This allows the E|j/N 0 required 
to maintain a BER of 5xl0~ 7 to be accurately determined by a linear Interpola- 
tion between the last and next-to-last data points. 

A typical measured BER versus Et>/N 0 curve Is shown In Fig. 1. The theo- 
retical (or Ideal) curve Is usually shown for comparison. Such a curve can be 
obtained by measuring the BER while varying the E^/Ng In 1 dB Increments. 

The starting Eb/N 0 value Is determined from the theoretical curve where the 
BER Is about 10~ 2 . The Eb/N 0 Is Incremented by 1 dB until the measured BER 
has exceeded the performance goal, at which time the last data point Is taken 
and the measurement Is stopped. 

The system for performing this measurement Is described by the block dia- 
gram shown In Fig. 2. A range of values of E^/Ng can be obtained under com- 
puter control using a noise Insertion system described In the next section. 

The data generator provides a pseudo-random bit stream to the modulator at the 
required rate. After the modulated signal has been transmitted through the 
system under test, the signal (plus noise) Is demodulated and the resulting 
data sequence sent to the data checker. The data checker, after receiving an 
Initial control word, regenerates the original pseudo-random data sequence and 
compares It, bit by bit, to the data sequence received from the demodulator 
(Ref. 1). The bit-errors, as well as the total number of bits received, are 
counted by the data checker. The control computer obtains these counts from 
the data checker and calculates the bit-error rate. The control computer also 
monitors signal and noise levels and calculates a table of BER and E|j/N 0 
values characterizing the system under test. 

Noise Insertion and Efr/N 0 Measurement 

Once a communications system has been placed In service, a single BER 
measurement characterizes the performance of the system. The slgnal-to-nolse 
ratio (or energy-per-blt to noise ratio, E^/Ng) Is a function of the noise pre- 
sent In the system and the transmitted signal power level and Is a fixed 
quantity. The noise Is usually thermal noise In the system plus extraneous 
noise, such as background noise and Interference received by an antenna. 

In a laboratory test, the antenna background noise can be eliminated and 
the thermal noise can usually be controlled, so that the received E^/Ng can 
be varied by adding white (Gaussian) noise. A noise Insertion system such as 
shown In Fig. 3 (Ref. 2) Is used to provide the variable Ejj/N 0 . The control 
computer varies the Eb/N 0 In 1 dB Increments through a programmable step 
attenuator (labeled A1 In Fig. 3). The second programmable attenuator (A2) 
controls the output power level. The power monitor port Is coupled to the out- 
put signal line to allow signal and noise power measurements to be made. Since 
the noise source produces broadband white noise, a bandpass filter approxi- 
mating the bandwidth of the system under test Is placed ahead of the power 
meter to Improve noise measurement accuracy. 
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The noise Insertion can be accomplished at the Input to the system under 
test as well as at the output. For example, In testing a satellite receiver, 
noise Inserted at the Input would simulate noise on the satellite uplink. For 
most measurements, however, the noise Is added at the output of the system 
under test. In this case, measurement of the Et,/N 0 Is relatively simple. 

A measurement of the signal power Is made at the power monitor port by 
turning off the noise power (setting attenuator A1 set to Its maximum setting). 
Through the control computer, the modulated signal Is temporarily turned off 
and attenuator A1 Is returned to Its setting for the next measurement point. 
After the noise power has been measured, the modulated signal Is turned on and 
the BER measured. This process Is repeated for each measurement point until 
the complete BER versus E|/N 0 curve has been obtained. 

Once the ratio of measured signal power to measured noise power has been 
calculated, two adjustments are required to yield the E|j/N 0 . The first 
adjustment converts the slgnal-to-nolse ratio to the energy-per-blt to noise 
ratio. This Is done by calculating ratio of the channel bandwidth to the bit 
rate. This quantity, which represents the difference between the signal power 
and the energy-per-blt. Is then added to the measured slgnal-to-nolse ratio. 

For example, If a modulated signal at 100 Mbps were being transmitted with a 
channel bandwidth of 200 MHz, the bandwidth to bit rate ratio of 2 (or 3 dB) 
must be added to the measured slgnal-to-nolse ratio to yield Ei,/N 0 . 

The second adjustment to the Et>/N 0 takes Into account the bandwidth of 
the filter on the power monitor port. The ratio of the noise bandwidth of this 
filter (usually taken as the 3 dB bandwidth when the filter Is 5th order or 
higher. Ref. 3) to the channel bandwidth must be added to the E|j/N 0 to adjust 
for the out-of-channel noise measured during the noise measurement. For 
example, If the filter on the power monitor port has a bandwidth of 235 MHz 
while the measurement channel bandwidth Is 200 MHz, 1.175 (or 0.7 dB) must be 
added to the Et,/N 0 . Note that this adjustment Is usually not needed for the 
signal measurement, since the power level of the signal near the band edges Is 
low compared to the band center, while the noise power density Is uniform 
across the band. 

When the noise Is Inserted at the Input to the system under test rather 
than at the output, It Is necessary to measure the E|,/N 0 at the Input also, 
particularly If there are nonlinear active devices In the system. The non- 
linear devices tend to suppress the noise when the signal Is present, yield- 
ing a lower actual noise level than Is measured with the signal off. The 
result Isa difference between the measured E^/Nq and the actual Et,/N 0 at 
the system output. This error Is dependent on the Eb/N 0 at the system Input 
and cannot be measured accurately. 

Difficulties In E|j/N 0 measurement occur when Interference or spurious 
signals are present. These signals, which are Independent of the modulated 
signal, will contribute unequally to the noise power measurement and the signal 
power measurement and thus yield an erroneous E[j/N 0 . If the Interference was 
created Intentionally (for example, In a test Intended to measure the effects 
of Interference on the system), the Interfering signals can be removed while a 


3 



baseline measurement Is made. The Ep/N 0 values from this baseline measure- 
ment are then applied to the subsequent BER measurements made with the 
Interference present, and the Eb/N 0 's obtained during these subsequent 
measurements are disregarded. If the Interference or spurious signals are 
Inherent In the system and cannot be controlled, a baseline set of E^/Nq 
values can be obtained In a different way. The system under test Is removed 
and replaced with sufficient attenuation or amplification to create a test 
signal equal In power level to the signal at the output of the system under 
test. The BER versus E^/No measurement made with this test signal will 
provide an adequate set of baseline Eb/N 0 values to apply to BER measure- 
ments made on the system with the Interference or spurious signals present. • 

Time Requirements for Accurate Bit-Error Rate Measurement 

The bit-error rate for a digital communications system Is primarily a 
function of the slgnal-to-nolse ratio at the data detector. Since the noise Is 
random In nature, the number of bits checked must be large enough to Insure, 
with a reasonable probability, that the BER measurement Is accurate to within a 
desired error bound. 


Applying probability theory to the counting of bit-errors allows calcula- 
tion of the minimum number of bits required to be checked to obtain a desired 
BER measurement accuracy. This Is done by recognizing the binomial nature of 
the counting of bit-errors, where each of n received bits has some probabil- 
ity of being In error. Since the probability of a bit being In error Is rela- 
tively small (less than 0.01), and the number of bits checked Is quite large 
(»1000), a Poisson approximation to the binomial distribution can be accu- 
rately used (Ref. 4). The Poisson approximation yields an expression for the 
standard deviation which can be used In Chebychev's Inequality to yield the 
following equation. 


where 


Probability n < 


(1 -P)bE 2 


> P 


n Is the number of bits checked 
b Is the actual BER 

P Is the probability of the measured BER falling within ±E of the actual BER 
for n bits checked 

E Is the measurement error bound, defined as 

E = (b 1 Is the measured BER) 

From the above equation, one can calculate the number of bits, n, required 
to yield a BER measurement that Is within a given error bound, E, with a proba- 
bility P. The results of several such calculations are plotted In Fig. 4. 

The number of bits required, n, Is plotted against the actual BER for three 
error bounds and three probabilities. For example, when the BER Is 10~&, 
checking 10 12 bits will result In a measurement error of less than 0.01 for 
99 percent of the measurements made. The amount of time required for the 
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measurement is obtained by dividing the number of required bits by the data 
rate. 


In order to minimize the time required to measure a complete BER versus 
E|j/N 0 curve, an algorithm Is employed which varies the measurement time based 
on an Initial BER measurement. An example of the algorithm Is shown In Fig. 5. 
At a data rate of 220 Mbps, the algorithm yields an average measurement time of 
35 min for a complete curve (BER measured from 10-2 to 10~ 8 ) with an error 
bound of 0.1 and probability of 0.9. 

Computer Control and Data Processing Considerations 

The control computer shown In Fig. 2 Is a 32-bit minicomputer. The com- 
puter Is configured as an Experiment Control and Monitor (EC&M) Computer, 
capable of performing numerous RF measurements as well as data transmission 
tests (Ref. 5). The EC&M software consists of several libraries of Instrument 
control modules, managed by three phases of control programs, as shown In 
Fig. 6. 

In the first EC&M software phase, a menu-driven setup program Is used to 
create two files required to control the test. The test definition file (TDF 
In Fig. 6) contains all of the necessary Information on the Instruments and 
devices to be controlled and monitored during the test, such as device type and 
address, and limits on device settings or Instrument readings. The sequence 
control file (SDA In Fig. 6) contains the control sequence which accesses the 
Instrument control modules In the proper order. 

The second phase consists of a control program and a display program. 

The control program uses the TDF and SDA files to execute the sequence of 
actions required to perform the test. The control program also collects and 
checks the validity of data by comparing It to the limits established In the 
TDF file, and stores the data In the DAT file (Fig. 6). The display program 
allows the test engineer to Interface to the test In progress, and provides a 
constantly updating display giving the status of the test being run and the 
latest set of data collected. 

The third phase of the EC&M control software Is the data processing 
phase. The data file can be printed directly or processed through a separate 
data processing program to yield the test data In a desired format. 

The Interaction of the control programs with the various Instrument con- 
trol module libraries for the BER versus Efc/No test Is shown In Fig. 7. 

The devices to be controlled by the EC&M for this test (as shown In Figs. 3 
and 4) are the data generator, the data checker, two step attenuators, and a 
power meter. 

The data generator and checker are custom built devices controlled by a 
6809 microcomputer. The EC&M communicates with the microcomputer through an 
RS-232 Interface. The data generator need only be commanded to turn on or off 
at the appropriate times. The data checker. In addition to being turned on or 
off, provides BER data to the EC&M, which Is decoded to yield the total number 
of bits received and the total number of errors counted. 



The power meter control module allows for zeroing of the meter by remov- 
ing the RF signals and looping through the zeroing command until a zero reading 
Is obtained. The step attenuators are controlled by reading the attenuator 
status, calculating the next setting, and obtaining the proper command from a 
look-up table. 

An example of a BER versus Ej-,/N 0 test sequence using an SMSK modulator 
and demodulator operating at a rate of 220 Mbps which has been successfully 
Implemented can be described. Once Instruments have been zeroed and set In an 
Initial mode, the test begins by setting the Initial E^/Nq to about 5 dB. 

From the theoretical curve, this will yield a BER of about 10*2. This and the 
next several data points can be obtained accurately with measurement times of 
5 second. The sequence for measuring these points consists of determining the 
correct attenuator settings and measuring the E|j/N 0 as described above In 
the Eb/N 0 measurement section. The data generator and checker are turned on 
and a 5 sec wait statement Is executed. The BER Information Is obtained from 
the data checker, and the program moves on to the next measurement point. Bit- 
errors occasionally occur In the control word sent by the data generator. As 
a result, the data checker does not restart the pseudo-random data sequence 
properly and a 50 percent BER Is erroneously measured. This problem Is avoided 
by taking 5 samples at each measurement point and averaging the results. If a 
control word error has occurred In one or more of these samples, the average 
calculated will be close to 50 percent. If an unexpectedly bad average Is 
noted, the bad sample(s) are found and discarded and the average recalculated, 
avoiding a time-consuming repeat of the measurement. 

After the first 5 points have been measured, the algorithm described In 
Fig. 5 Is Implemented. For this measurement, a performance goal of 5x10-7 has 
been set. From the theoretical curve. It was determined that with Et,/N 0 
Increments of 1 dB, no measurement need be taken beyond a BER of 10-8 to 
Insure at least on data point less than 5x10-7. once 10 -8 has been reached, 
the test Is stopped and the result Is a measured curve such as the one shown In 
Fig. 1. 

The execution of a BER versus Et,/N 0 measurement results In a large data 
file which contains the status and measurement results for each step of the 
test sequence. Since up to 500 sequence steps may be executed during a test, 
two data processing programs are used to distill the data. The first program 
selects all of the necessary valid data values from the test data file. This 
Includes the signal and noise power measurements and all of the BER samples at 
each measurement point. The Et»/N 0 and the BER averages are calculated and a 
table of BER versus Et,/N 0 values Is printed. A second program Is Implemented 
on a desktop computer so that It can be used while BER tests are being run. 

This program stores the data tables on a 5-1/4 In. disk, performs analytical 
calculations such as curve fitting and BER degradation of a measured curve 
from the theoretical curve. The BER curves and plots of the BER degradation 
as a function of another measurement parameter can be plotted through this 
second program. 

An example of this type of data reduction and plotting Is shown In Fig. 8. 
A series BER versus E[j/N 0 measurements was performed for a satellite communi- 
cations system In which the Input drive level of the satellite high power 
amplifier was successively backed off In 2 dB Increments. The resulting BER 
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curves are shown In Fig. 8(a). A clearer picture of the effect of Input drive 
level backoff on BER can be obtained by calculating the additional E^/Nq 
required at the performance goal ( 5x1 0 - ^ ) and plotting this result against the 
amplifier Input drive level, as In Fig. 8(b). 

Conclusion 


A system for the efficient measurement of bit-error rates as a function of 
the energy-per-blt to noise power ratio has been described. The system gives 
accurate measurement results In a minimum amount of time. Noise Insertion and 
E^/Nq measurement considerations and time requirements for BER measurement 
accuracy have been discussed. Computer control and data processing methods 
required for automating bit-error rate measurements have been described. 
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FIGURE 1. - TYPICAL MEASURED BER VERSUS E b /N 0 
CURVE. 



FIGURE 2. - SYSTEM FOR THE MEASUREMENT OF BIT-ERROR RATE VERSUS Eb/No. 
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FIGURE 3. - NOISE INSERTION SYSTEM. 



BIT-ERROR RATE 


FIGURE 4.- NUMBER OF BITS REQUIRED VERSUS 
BIT-ERROR RATE FOR THREE ERROR BOUNDS (E) 
AND THREE PROBABILITIES (P). 
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INCREASE Et/N 0 BY 1 dB 


FIGURE 5. - BER MEASUREMENT TIME ALGORITHM FOR A DTA RATE OF 220 Mbps. 
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FIGURE 6.- PHASES OF THE E C AND M CONTROL SOFTWARE. 
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FIGURE 7. - E C AND M CONTROL PROGRAM AND MODULE LIBRARY INTERACTION. 
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E b /N 0 CdBJ 


(A) BER PLOTTED AGAINST E b /N 0 . 



AMPLIFIER INPUT BACKOFF CdB] 


(B) DEGRADATION OF Ej/Nq FROM THE THEORETICAL CURVE 
PLOTTED AGAINST AMPLIFIER INPUT BACKOFF AT BER = 
5x10" 7 . 

FIGURE 8. - EXAMPLE OF BER MEASUREMENTS (IN TVO 
PLOTTING FORMATS) FOR A SATELLITE COMMUNICATIONS 
LINK WHERE THE SATELLITE HIGH POWER AMPLIFIER 
INPUT HAS BEEN SUCCESSIVELY BACKED OFF IN 2 dB 
INCREMENTS. 
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